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FOREWORD 


The  Manpower  and  Personnel  Policy  Research  Group  of  the  Army  Research 
Institute  (ARI)  performs  research  in  the  issues  of  manpower,  personnel,  and 
training  of  particular  significance  to  the  U.S.  Army.  This  research  addresses 
the  issue  of  the  effectiveness  of  Armed  Forces  Qualification  Test  in  predicting 
manpower  performance  and  was  prepared  as  part  of  ARI's  continuing  support  for 
the  Office  of  the  Deputy  Chief  of  Staff  for  Personnel. 


EDGAR  M.  JOHNSON 
Technical  Director 
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THE  IMPACT  OF  SOLDIER  QUALITY  ON  PERFORMANCE  IN  THE  ARMY 


EXECUTIVE  SUMMARY 


Requirement: 

The  Army  has  been  successful  in  improving  its  manpower  quality  over  the 
last  several  years.  Recruits  are  scoring  higher  on  the  Armed  Forces  Qualifica¬ 
tion  Test  (AFQT)  and  are  more  likely  to  have  high  school  diplomas  than  in  any 
year  since  the  inception  of  the  All-Volunteer  Force.  Recruiting  such  person¬ 
nel  is  expensive,  however,  as  the  Army  faces  increased  competition  from  the 
civilian  labor  market,  educational  institutions,  and  the  other  services  for  a 
shrinking  youth  population.  In  order  to  justify  its  manpower  requirements,  the 
Army  must  be  able  to  demonstrate  an  empirical  link  between  AFQT  scores  and  sol¬ 
dier  performance:  AFQT  is  designed  to  measure  trainability.  However,  its 
value  as  a  predictor  of  performance  must  be  empirically  verified.  This  re¬ 
search  presents  evidence  on  that  relationship  using  data  from  several  sources: 
the  Army's  training  schools  and  Skill  (Salification  Tests  (SQT) . 


Procedure : 

The  performance  measures  are  modeled  in  a  multivariate  regression  model, 
using  an  instrumental  variables  technique  to  correct  for  measurement  error  in 
the  AFQT  variable.  Other  explanatory  variables  are  sex,  race,  education.  Army 
experience,  and  training. 


Findings : 

The  results  of  the  analysis  on  the  TRASANA  training  data  and  the  1983 
skill  level  two  SQT  data  demonstrate  that  AFQT,  a  measure  of  trainability,  is 
a  significant  predictor  of  performance  in  the  Army.  The  performance  and  skill 
measures  used  in  this  study  are  imperfect,  but  the  consistency  of  the  relation¬ 
ship  across  types  of  performance  measures  and  across  MOS  is  impressive.  The 
analysis  of  the  SQT  data  is  reported  for  several  large  representative  MOS,  but 
the  pattern  is  also  consistent  for  almost  all  MOS  having  sufficient  observa¬ 
tions  to  permit  analysis.  Holding  the  effect  of  other  variables  constant,  AFQT 
exerts  a  positive  and  significant  influence  on  Army  performance.  No  other 
variables  are  consistently  significant  across  all  MOS  in  both  data  sets.  These 
findings  are  consistent  with  another  study  that  also  documented  the  positive 
impact  of  AFQT  scores  on  Army  soldier  performance  for  tankers. 


Utilization  of  Findings; 

The  empirical  analysis  demonstrates  that  AFQT  scores  are  indeed  a  signif¬ 
icant  and  consistent  determinant  of  Army  performance  for  a  variety  of  perfor¬ 
mance  measures.  The  equations  indicate  how  much  additional  performance,  on 
average,  is  associated  with  an  increase  in  AFQT  scores.  This  information 


supports  the  current  Army  policy  of  recruiting  high-quality  manpower,  because 
the  higher  recruiting  co9ts  are  offset  by  increased  labor  productivity.  Ear¬ 
lier  versions  of  this  analysis  done  in  collaboration  with  MAJ  Thomas  Daula 
were  used  by  the  Army  to  support  current  quality-recruiting  goals  before 
Congress  in  Defense  Manpower  Quality,  Report  to  the  House  and  Senate  Commit¬ 
tees  on  Armed  Services,  Volume  11,  Hay  1985,  appendixes  E  and  I. 
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The  Impact  of  Soldier  Quality  on  Performance  In  the  Army 


David  K.  Horne* 

The  productivity  of  an  individual  on  the  job  depends  upon  such  unobservable 
personal  attributes  as  ability,  motivation,  physical  coordination,  and  other  job-specific 
skills.  Employers  who  lack  information  on  the  potential  productivity  of  job  applicants 
may  use  various  proxies  for  these  skills.  Education,  for  example,  may  be  an  indicator  of 
productivity  if  individuals  learn  skills  in  school  which  may  he  applied  to  the  job.  This  is 
the  assumption  of  the  human  capital  model. ^  Alternatively,  if  individuals  with  more 
’ability*  are  more  likely  to  have  additional  education  through  a  sorting  mechanism, 
education  and  productivity  will  be  positively  correlated.  Employers  may  then  use 
education  to  screen  applicants.^  Education,  experience,  scholastic  achievement  and  other 
productivity  proxies  may  he  useful  for  predicting  performance  on  the  job. 

One  alternative  to  using  general  performance  or  skill  proxies  is  to  develop 
instruments  which  could  be  expected  to  predict  performance.  For  example,  college 
entrance  exams  are  useo  to  predict  scholastic  success.  Another  example  is  the  test 
which  the  Armed  Forces  administer  each  year  to  hundreds  of  thousands  of  youths.  The 
Armed  Forces  Qualifications  Test  (AFQT)  is  designed  to  measure  the  trainahllity  of 
applicants.  The  test  is  used  by  all  the  services  to  screen  out  individuals  who  might  be 
expected  to  fail  training  in  their  MOS.  (Army  jobs  are  classified  into  Military 
Occupational  Specialties  (MOS)). 


*  U.S.  Army  Research  Institute,  5001  Eisenhower  Avenue,  Alexandria,  VA  22333.  The 
author  is  grateful  to  MA)  Thomas  Oaula  for  helpful  suggestions,  and  to  colleagues  for 
comments  on  an  earlier  version.  The  views  expressed  are  solely  those  of  the  author. 
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This  screening  device  can  be  de'ended  only  if  a  relationship  exists  between  the  test  score 
and  job  or  MOS  performance,  since  the  objective  of  the  selection  process  is  to  acquire 
recruits  who  will  perform  well  as  soldiers  rather  than  as  students.  This  analysis 
demonstrates  that  AfQT  score  is  positively  relatid  to  MO^-speciflc  performance.  This 
conclusion  has  specflc  policy  implications.  Current  Army  recruiting  policy  requires 
substantial  resources  to  attract  high-scoring  recruits,  turning  away  many  individuals  who 
desire  to  enlist  hut  who  do  poorly  on  the  AFOT.  The  emphasis  on  the  so-called  high 
quality  recruits  can  only  be  justified  if  AFQT  scores  can  he  shown  to  he  a  determinant  of 
productivity. 

Section  1  discusses  the  methods  and  uses  of  the  AFQT  and  neformance  tests  In  the 
Army.  Section  2  contains  a  discussion  of  the  model  and  the  data  used  in  the  analysis. 
The  results  are  discussed  in  section  3.  Policy  implications  and  conclusions  are  presented 
in  section  4. 

Ability  and  Performance 

The  purpose  of  this  analysis  Is  to  relate  the  Army’s  measure  of  trainahility  to  joh  or 
MOS  performance  measures.  The  trainahility  measure  will  he  discussed  first,  followed  hy 
a  discussion  of  performance  measures. 

Ability  Measurement 

One  can  argue  that  'ability*  is  too  broad  and  ambiguous  to  he  measured  well  on  a 
one-dimensional  scale.  Nor  is  ability  the  Army's  primary  concern.  The  Army  takes 
recruits,  many  with  no  prior  work  experience,  and  trains  them  in  a  particular  MOS, 
Advanced  individual  training  is  accomplished  subsequent  to  basic  training  and  may  last 
from  as  little  as  six  weeks  to  as  long  as  six  months  or  more.  The  concept  of  trainahility 
Is  well  defined.  The  AFQT  is  designed  to  be  a  general  measure  of  trainahility  and  is 
composed  of  a  number  of  sub-tests  of  the  Armed  Services  Vocational  Aptitude  Battery. 


Other  combinations  of  suhtests,  known  collectively  as  aptitude  are*  composites,  are 
created  to  measure  more  narrow  types  of  aptitude  for  mechanical,  electronics,  clerical 
and  other  areas* 

Individuals  tested  are  assigned  scores  In  percentile  terms  relative  to  the  1980  youth 
population  of  18*23  year  olds*  By  law  the  applicants  must  score  above  the  9th  percentile 
to  be  eligible  for  enlistment*  The  number  of  applicants  who  can  be  recruited  In  the  10th 
through  30th  percentiles,  particularly  without  a  high  school  diploma,  is  also  limited  by 
Congressional  mandate.  However,  the  Army  attempts  to  recruit  above-average  (AFQT 
of  SO  or  above)  individuals  whenever  possible.  The  percentage  of  non-prior  service 
regular  Army  recruits  scoring  in  the  top  SO  percentiles  has  risen  from  26.0  percent  in 
fiscal  year  1980  to  63.4  percent  in  fiscal  year  1984.  Over  the  same  period  the  number  of 
male  recruits  with  high  school  diplomas  has  risen  from  48.9  percent  to  89.4  percent.  This 
trend  can  be  attributed  partially  to  changes  in  recruiting  practices  as  well  as  to  changes 
in  the  recruiting  market. 

Recruiting  high  quality  individuals,  defined  both  in  terms  of  AFQT  scores  and  high 
school  diploma  status,  is  particularly  expensive.  Substantial  recruiting  resources  are 
devoted  to  attracting  these  individuals  to  the  Army,  because  the  Army  faces 
considerable  competition  from  educational  Institutions,  the  civilian  labor  market,  and 
other  services.  At  the  same  time,  the  Army  turns  away  many  lower  quality  applicants 
who  could  be  obtained  at  a  much  lower  recruiting  cost. 

There  are  two  easily  identified  benefits  to  recruiting  high  quality  individuals. 
These  recruits  tend  to  complete  their  tours  more  often  than  lower  category  recruits,  it 
Is  costly  for  the  Army  to  recruit  and  train  soldiers  who  leave  the  Army  before 
completing  the  tour.^  Attrition  rates  have  reached  30  percent  in  recent  years.  The 
second  benefit  is  performance.  As  equipment  used  in  the  Army  becomes  increasingly 
sophisticated,  increased  productivity  In  Army  manpower  will  translate  Into  cost  savings 
and  increased  force  readiness.  Unfortunately,  neither  productivity  nor  performance  can 
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be  easily  measured. 

Performance  Measures 

Manpower  productivity  in  the  Army  is  not  easily  defined.  Soldiers  trained  for 
combat  might  be  considered  most  successful  if  they  are  a  deterrent  to  war.  Skills  which 
may  be  valuable  during  peace  may  be  less  valuable  during  combat,  while  combat  skills 
may  produced  little  'output*  during  peacetime.  However,  other  things  constant,  the 
Army  should  prefer  soldiers  who  can  operate  or  maintain  equipment  to  those  who  cannot, 
or  soldiers  who  can  successfully  distinguish  between  friendly  and  hostile  aircraft  and  who 
can  hit  targets  to  those  who  cannot.  Although  the  value  of  'output*  is  difficult  to 
ascertain,  the  Army  does  evaluate  soldier  proficiency.  These  proficiency  tests  may  he 
considered  one  type  of  performance  measure. 

This  study  uses  two  performance  measures.  The  first  source  is  composed  of  test 
scores  on  a  variety  of  written  and  hands-on  tests  from  the  Army's  training  schools.  The 
tests  will  be  discussed  in  more  detail  in  the  next  section.  The  AFQT  was  originally 
validated  on  training  data  and  should  be  positively  associated  with  the  training  test 
scores. 

The  second  performance  measure  used  in  this  study  is  the  Skill  Qualifications  Test 
(SQT).  The  SQT  is  currently  a  written  (multiple  choice)  test  created  by  subject  matter 
experts  for  each  MOS  (except  for  a  number  of  exempt  MOS).  A  SQT  is  given  each  year 
at  four  different  skill  levels  which  correspond  to  experience.  The  skill  level  *  test  is 
administered  to  soldiers  through  the  E-4  grade.  The  skill  levels  2  through  4  are  given  to 
grades  E-5,  E-6,  and  E-7  respectively.  Soldiers  are  tested  on  M OS-specific  tasks  which 
are  contained  in  the  Soldier's  Manual  for  each  MOS. 

The  SQTs  are  not  direct  performance  measures.  Rather,  they  measure  skills  and 
knowledge  required  for  performing  the  tasks.  It  is  reasonable  to  assume  that  soldiers 
who  score  higher  on  the  SQT,  other  things  equal,  will  demonstrate  better  performance  In 
the  field. 
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However,  the  SQTj  suffer  from  a  number  of  deficiencies*  A  U.S.  General 
Accounting  Office  report  noted  that  the  SOT  is  used  hy  the  Army  for  two  somewhat 
inconsistent  functions*.  The  SQTs  were  originally  developed  to  evaluate  training 
programs  and  to  indicate  deficiencies  in  training.  The  tests  are  also  used  for  personnel 
evaluations*  The  test  score  is  recorded  on  soldier's  personnel  files  and  Is  used  for 
promotion  decisions.  A  score  of  8fl  Is  required  for  promotion  unless  a  waiver  is 

obtained.  Because  commanders  are  responsible  for  preparing  their  troops  to  do  well  on 

the  SQT  for  their  personnel  evaluations,  training  becomes  directed  toward  improving 
evaluations  rather  than  improving  skills,  and  both  functions  of  the  SOTs  become  less 
effective. 

Before  the  SQTs  are  administered  each  year,  soldiers  are  given  a  list  of  the  critical 
tasks  on  which  they  will  be  tested.  Those  soldiers  who  receive  refresher  training  may 

train  specifically  for  those  tasks,  and  training  often  occurs  Just  prior  to  the  SQT 

testing.  Therefore  the  annual  refresher  training  designed  to  maintain  skills  is  largely 
directed  towards  passing  the  current  SQT.  In  addition,  analysts  of  Army  personnel  files 
indicates  many  missing  values  for  SQT  scores.  About  30  percent  of  the  enlisted 
personnel  files  for  E-5  had  no  SQT  score  by  the  end  of  19B4. 

In  spite  of  problems  with  the  SQT,  the  test  does  provide  a  measure  of  skill 
knowledge  for  a  wide  range  of  MOS.  The  direct  link  between  SQTs  and  actual  job  or  MOS 
proficiency  is  not  observed.  However,  given  the  nature  of  the  tests,  it  seems  reasonable 
to  assume  that  soldiers  who  demonstrate  greater  skill  knowledge  on  the  SOTs  will 
generally  be  more  productive  in  the  MOS.  Numerous  other  personal  attributes,  some 
observable  and  some  unobservable,  will  atso  Influence  productivity.  We  attempt  to 
control  for  some  of  the  observable  characteristics  in  the  regression  equations. 
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The  Model 


There  ere  s  number  of  variable*  which  ere  associated  with  productivity  In  the 
human  capital  and  signalling  models.  Experience  for  example,  should  Increase  job  skills 
because  training  takes  place  over  time.  Education  may  provide  marketable  skills  and 
may  also  act  as  a  sorting  mechanism.  In  this  sample  of  enlisted  soldiers  there  is  little 
variance  in  years  of  education,  hut  variation  in  high  school  diploma  status  does  exist. 
Craduates  are  probably  more  motivated  and  goal  oriented. 

The  type  of  training  received  by  soldiers  is  also  an  important  determinant  of 
productivity.  Information  is  not  available  on  the  quality  of  training,  but  It  is  possible  to 
distinguish  between  soldiers  who  have  been  assigned  to  MOS  In  which  they  received  their 
training  and  those  who  have  been  assigned  to  MOS  for  which  they  were  not  trained. 

Several  demographic  variables  included  in  this  analysis  are  likely  to  influence  SOT 
scores.  Opportunities  for  education,  training  or  employment  In  the  civilian  sector  may 
differ  by  race  or  sex.  The  propensity  or  taste  for  military  service  may  also  differ 
between  these  groups.  The  other  variables  included  In  the  model  cannot  fully  correct  for 
these  unobserved  differences  between  groups.  Therefore  both  sex  and  race  may  be 
significant  variables  in  the  equations. 

The  general  model  is  specified  in  the  following  form: 

1.  Performance»f(Tralnabillty,  Education,  Experience,  Training,  Sex,  Race). 


The  variables  used  as  measures  of  these  are: 


Performance: 

Tralnability: 

Education: 

Experience: 

Training: 

Sex: 

Race: 


Training  Data,  SOT  scores 
AFQT  scores 

High  School  diploma  status 
Months  in  service,  rank 
Training  In  same  MOS 
Sex 

White  or  non-white 
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The  major  relationships  of  interest  in  this  research  is  hetween  tralnability  and 
performance.  AFQT  is  an  accepted  measure  of  trainahllity.  More  trainahie  persons  are 
more  likely  to  acquire  the  skills  and  knowledge  required  to  perform  their  military 
assignments.  AFQT  may  also  reflect  abilities  other  than  those  required  tor  training 
success  which  contribute  directly  to  performance.  This  analysis  does  not  distinguish 
between  the  two  processes. 

Other  variables,  such  as  education  and  experience,  may  also  contribute  to  job 
performance.  These  variables  may  have  a  direct  effect  on  performance  because  they  are 
correlated  with  skills  or  knowledge  or  ability.  Such  variables  may  also  have  an  indirect 
through  the  AFQT  variable:  more  education  is  associated  with  higher  AFQT  scores,  for 
example.  The  purpose  of  using  multivariate  regression  estimation  is  to  measure  the 
direct  contribution  of  each  variable.  Excluding  variables  such  as  education  or  experience 
which  may  be  significant  determinants  of  performance  leads  to  omitted  variahle  bias  - 
the  estimates  of  the  impact  of  AFQT  will  be  biased.  This  estimation  problem  has  policy 
repercussions.  If  AFQT  is  positively  correlated  with  experience  and  education,  for 
example,  a  un> variate  regression  of  SQT  score  against  AFQT  score  will  exaggerate  the 
effect  of  thy  AFQT  variable.  The  considerable  cost  of  administering  the  AFOT  and  of 
recruiting  high-scoring  individuals  can  only  be  defended  if  AFOT  has  an  effect  on 
performance  independent  of  other  variables.  If  AFQT  is  a  proxy  for  education,  for 
example,  then  education  and  not  AFQT  score  should  be  the  selection  criterion. 
Therefore,  neither  simple  correlations  or  univariate  regression  results  can  be  used  to 
defend  manpower  quality  goals  specified  in  terms  of  AFQT  scores.  AFQT  score  is  only 
appropriate  as  a  selection  criteria  if  the  it  contlbutes  to  soldier  performance  independent 
of  other  variables. 

Estimation  of  the  relationship  between  performance  and  the  explanatory  variables 
is  complicated  by  the  fact  that  AFQT  score  is  an  imperfect  measure  of  ability  or 
tralnability.  Therefore  the  observed  data  matrix,  X,  consists  of  the  true  data  X  plus  a 
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measurement  error  term  V; 


2.  X  a  X  ♦  V. 

The  true  model  may  then  he  expressed  as 

3.  y  ■  X  *  ♦  m  »  X#  ♦  (u  -Vfi), 

where  y  and  u  denote  the  Independent  variable  and  error  matrices  respectively.  The 
least-squares  estimator  of  the  true  coefficient  Is 

4.  *  «  (X'X)’1  X*y. 

Johnson  has  demonstrated  that  the  ordinary  least  squares  estimator  of  4  given  In 

equation  4  is  inconsistent  and  asymptotically  biased  because  the  observed  data  matrix  Is 

correlated  with  the  error  term^.  One  method  to  correct  for  the  errors-ln-varlables  is  the 

instrumental  variables  (IV)  technique.  An  instrumental  variables  estimator  will  he 

consistent  and  asymptotically  unhaised.  If  the  matrix  Z  is  an  instrument  which  is 

* 

uncorrelated  with  the  errors  such  that  pllm  (1/n  Z  u)  ■  0,  the  IV  estimator  of 
•  Is  b,  where 

5.  b  -  (z'xf1  z'y 

and  the  asymptotic  variance  of  b  Is 

6.  asy  var  (b)  -  t*  (Z*X)-1  l  l  (x'zf1, 

II 


e 


where  t  denotes  the  variance  of  the  error  term  (u). 

The  Instrument  chosen  for  AFQT  score  In  this  study  is  the  rank  ordering  of  scores, 
where  the  lowest  score  receives  a  value  of  one  and  the  highest  score  receives  a  value  of 
rw  This  is  shown  as  a  Ourbin  Instrument6.  This  Instrument  Is  correlated  with  AFOT 
score,  but  Is  uncorrelated  with  the  errors.  The  other  explanatory  variables  are  used  as 
their  own  instruments. 


Data 

This  analysis  uses  two  data  sets.  The  first  data  set  is  training  data  for  selected 
MOS.  The  second  data  set  Includes  SQT  scores  from  the  1983  test. 

Training  Data 

The  training  data  (from  the  Army  Training  Centers)  included  a  number  of  MOS 
from  several  missile  systems.  The  PERSHINC  II  missile  data  covered  basic  malntanence 
testing  for  MOS  15E  and  21C  (MOS  descriptions  are  provided  in  the  appendix)  and  was 
created  from  multiple-choice  questions.  The  STINCER  antiaircraft  system  (MOS  IfiS) 
testing  Included  a  written  test  on  system  knowledge,  preventive  malntanence,  system 
characteristics  and  other  operations;  a  range  ring  profile  test  of  aircraft  type,  range  ring 
coverage,  and  correct  action;  two  visual  aircraft  recognition  tests  (photo  test  and  test 
from  slides)  and  two  hands-on  tests.  The  first  hands-on  test  was  probability  of 
Completing  launch  sequence  in  a  moving  target  simulator,  the  second  was  time-to-f Ire. 
The  LANCE  testing  consisted  of  several  tests  for  MOS  1SD  and  15).  The  written  test 
questions  were  taken  from  LANCE  manuals  and  SQTs.  A  map  reading  test  consisted  of 
17  multiple  choice  questions.  Each  LANCE  MOS  was  also  given  hands-on  operations  and 
malntanence  tests.  The  HAWK  missile  system  MOS  were  given  written  and  hands-on 
tests  for  general  equipment  knowledge  (16D  &  16E)  and  equipment  malntanence  (24C, 
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24E,  24C), 


These  hand-on  tests  are  M OS-specific.  Soldiers  responsible  for  maintenance,  for 
example,  are  asked  to  perform  system  checks,  or  to  diagnose  and  repair  faults  which 
have  been  Inserted  In  the  equipment.  Operators  are  asked  to  Identify  ;  ircraft  from 
pictures  or  slides,  make  the  conect  firing  decision,  and  complete  the  launch  sequence. 
The  tests  are  carried  out  at  the  training  centers  and  are  designed  to  reflect  the  tasks 
which  the  soldiers  will  perform.  The  tests  are  created  with  the  assistance  of  system 
experts. 

The  training  data  set  contains  a  number  of  varlahles  which  may  he  used  as 
explanatory  varlahles  in  the  regesslon.  These  include  sex,  race,  education,  and  training 
information  for  each  soldier.  Limited  information  on  length  of  service,  which  Is  an 
experience  proxy,  is  available  for  some  of  the  MOS.  Much  of  the  time-in-service  data  Is 
missing,  hut  rank  data  are  available.  Rank  is  largely  a  function  of  time  in  service, 
though  more  productive  soldiers  should  he  expected  to  he  promoted  more  rapidly7. 
Therefore  rank  should,  and  In  fact  does  appear  to,  have  more  explanatory  power  than 
time  in  service  alone.  Rank  cannot  be  strictly  interpreted  as  an  experience  variahle,  hut 
is  used  as  a  proxy  for  experience.  This  variahle  is  used  In  the  training  regressions. 

The  education  variable  has  little  variation.  Few  members  of  the  sample  have 
attended  college.  Past  research  has  shown  that  the  education  variable  which  appears  to 
have  the  most  impact  on  soldier  behavior  is  high  school  diploma  status.  This  Is  not  only 
an  indicator  for  the  amount  of  education,  but  may  also  reflect  an  individual's  tenacity 
and  feterminatlon  to  reach  goals.  The  training  variahle  (SAM CMOS)  indicates  whether 
an  Individual  received  training  In  the  sane  MOS  covered  by  the  SOT  test.  Generally,  one 
would  expect  that  training  In  the  same  MOS,  high  school  diploma  and  rank  should  all 
exert  a  positive  Influence  on  3QT  score. 

The  trainabllity  variable  used  in  this  study  is  AFQT  score.  The  applicants  are 
required  to  take  the  AFQT  to  enter  the  Army,  so  scores  should  be  available  for  each 
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soldier.  Soldiers  who  took  the  AFQT  originally  hetween  1976  and  I960  received  scores 
that  were  mlsnormed,  hut  they  have  heen  renormed  for  this  analysis.  MOS  performance 
can  he  considered  the  joint  output  of  tralnahlllty  of  the  Individual  and  the  training 
program.  Clven  a  fixed  training  program,  the  AFQT  score  Is  expected  to  have  a  positive 
Impact  on  MOS  performance. 

Some  assumptions  behind  the  analysis  should  he  made  explict.  In  particular,  the 
training  program  Is  held  constant.  It  is  likely  that  changes  In  the  training  program  will 
affect  the  Impact  of  AFQT  on  performance.  The  more  effective  the  training  program, 
the  more  proficient  the  soldiers  should  become.  Tralnahlllty  could  become  less 
important  as  training  effectiveness  Improves,  though  some  tradeoff  hetween  trainahility 
and  performance  would  he  anticipated  with  any  training  program.  The  estimated  impact 
of  AFQT  on  these  performance  measures  is  conditional  on  the  training  received  by  the 
soldiers.  Consistent  AFQT  effects  across  Mf»5  would  indicate  that  the  tralnahlllty  Is 
important  under  a  range  of  training  programs. 

SQT  Data 

The  SQT  analysis  utilized  the  skill  level  2  SQTs  (rank  E-5).  Many  of  those  who  had 
taken  skill  level  1  SQTs  had  taken  different  versions  of  the  AFQT  which  are  not  strictly 
comparable,  though  preliminary  analysis  showed  that  these  SQT  results  were  similar. 
The  SQT  level  3  and  4  samples  were  relatively  small.  A  sample  of  almost  53,000 
observations  was  available  for  skill  level  2  tests. 

SQT  scores  are  recorded  in  the  Army's  enlisted  personnel  files,  called  the  Enlisted 
Master  File  (EMF).  Other  available  variables  that  could  he  expected  to  influence 
performance  include  AFQT  scores,  education,  training,  race,  and  time-in-service.  The 
variables  used  in  the  regression  analysis  are  similar  to  those  used  in  the  training  data 
analysis.  The  results  for  several  large,  representative  MOS  are  presented  in  this  paper; 
these  are  generally  consistent  with  the  results  for  other  MOS  not  reported  here.  The 
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MOS  descriptions  are  provided  in  the  appendix. 


Results 


Training  Results 

The  Training  equations  are  provided  in  Tables  1  through  3  for  several  weapons 
systems:  the  HAWK,  STINGER,  PERSHING  II,  and  LANCE.  The  equations  for  the  two 
types  of  tests,  written  and  hands-on,  are  provided  separately. 

The  results  of  the  written  tests  {shown  In  Table  1)  demonstrate  that  the  AFQT 
variable  is  consistently  significant  across  systems  and  MOS.  The  lack  of  a  high  school 
diploma  is  significantly  negative  in  only  one  equation.  Rank  is  always  positive  and 
generally  significant.  The  race  coefficient  varies,  being  significantly  positive  in  one 
equation  and  negative  in  two.  The  training  in  the  MOS  has  mixed  effect. 

The  two  variables  which  stand  out  consistently  are  AFQT  score  and  rank.  In  the 
written  tests,  AFQT  score  Is  positive  and  significant  In  10  of  11  equations,  white  rank  is 
positive  and  significant  in  9  of  the  equations.  No  other  variables  are  as  consistent  across 
equations,  either  in  sign  or  significance.  Trainability  and  experience  appear  to  be  the 
major  determinants  of  the  written  test  scores  in  these  equations. 

The  hands-on  tests  which  are  reported  in  Tables  2  and  3  are  less  conclusive.  AFOT 
Is  significantly  positive  In  6  of  the  11  equations.  The  pattern  is  similar  for  rank.  The 
negative  coefficient  for  the  time-to-fire  test  is  consistent  with  the  other  results,  since 
brighter  and  more  experienced  soldiers  should  be  able  to  fire  the  mechanism  In  less 
time.  The  effect  of  the  other  variables  tends  to  vary  across  MOS. 
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Inst rwntal  Variable  Regression  Equations 
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SQT  Results 


The  SQT  results  are  demonstrated  for  several  MOS  which  are  generally 
representative  of  MOS  within  the  Army,  and  which  are  of  sufficient  size  to  provide  more 
precise  parameter  estimates.  The  results,  shown  in  Table  4,  are  In  many  ways  similar  to 
the  training  results.  The  AFQT  variable  is  significant  and  positive  in  all  the  MOS,  with 
the  coefficient  ranging  from  .07  to  .26.  The  coefficient  of  .26  Implies  that  for  each  4 
additional  points  on  the  AFQT  scored  by  a  soldier,  one  would  expect  the  SQT  score  to 
Increase  by  about  1  point  on  average. 

The  high  school  diploma  variable  Is  less  Important  than  the  AFQT  variable  as  a 
predictor  of  SQT  scores.  The  lack  of  a  diploma  is  insignificant  in  all  of  the  six 
equations.  The  signs  of  the  other  variables  are  generally  consistent  across  equations. 
The  experience  variable,  tlme-ln-servlce,  has  a  positive  effect,  as  does  training  in  the 
same  MOS  (SAM  6  MOS).  The  effect  of  sex  generally  varies  across  MOS.  The  race 
variable  is  significant  In  four  of  the  six  equations;  the  non-white  group  has  a  negative 
impact. 


Conclusions 

The  results  of  the  analysis  on  the  TRASANA  training  data  and  the  1983  skill  level  2 
SQT  data  demonstrate  that  AFQT,  a  measure  of  trainabllity.  Is  a  significant  predictor  of 
performance  In  the  Army.  The  performance  and  skill  measures  used  in  this  study  are 
imperfect,  but  the  consistency  of  the  relationship  across  types  of  performance  measures 
and  across  MOS  is  ’mpressive.  The  analysis  of  the  SOT  skill  level  2  data  is  reported  for 
several  large  representative  MOS,  but  the  pattern  is  also  consistent  for  almost  all  MOS 
having  sufficient  observations  to  permit  analysis.  Trainabllity,  as  measured  by  AFQT, 
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exerts  a  positive  and  significant  influence  on  Army  SOT  performance,  holding  the  effect 
of  other  variables  constant.  No  other  variables  appear  to  he  consistently  significant 
across  alt  MOS  in  both  data  sets.  These  findings  are  consistent  with  another  study  which 
also  documented  the  positive  impact  of  AFQT  score  on  Army  soldier  performance  for 
tankers  ®.  These  results  support  the  use  of  AFQT  as  a  screening  device  for  Army 
applicants. 

The  analysis  implicitly  assumes  that  training  policies  remain  stable  and  that 
increased  manpower  performance  can  he  attained  hy  attracting  higher  quality  recruits. 
The  returns  due  to  changes  in  quantity  or  quality  of  training  cannot  he  estimated  in  this 
framework.  If  training  pc  tides  were  significantly  altered,  the  relationship  between 
AFQT  and  performance  ml^ht  be  expected  to  change,  although  the  direction  of  the 
change  cannot  he  predicted  a  priori.  The  performance  measures  themselves  are  also 
likely  to  change  over  time.  Yet  evidence  of  a  positive  relationship  between  performance 
and  skill  measures  on  the  one  hand,  and  the  AFQT  on  the  other,  is  fairly  convincing.  The 
impact  of  other  variables  on  performance  is  less  consistent.  The  high  school  diploma 
generally  does  exert  a  positive  impact  on  performance,  as  does  experience  and  MOS' 
specific  training. 
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Appendix 

MOS  Descriptions 


MOS 
05C 
1  IB 
15D 
15E 
16D 
16E 
16S 
21G 
24C 
24C 
63B 
75b 
94b 
98G 


Description 
Radio  Operator 
Infantryman 
Lance  Crewmember 
Pershing  Missile  Crewmember 
Hawk  Missile  Crewman 
Hawk  Fire  Control  Crewmember 
Stinger  Crewman 

Pershing  Electric  Maintenance  Specialist 

Hawk  Firing  Section  Mechanic 

Hawk  Coordination  Central  Mechanic 

Light  Vehicle/Power  Generation  Mechanic 

Personnel  Administration  Specialist 

Food  Service  Specialist 

Electronic  Warfare/Signal  Intelligence  V 
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NOTES 


1.  Exposition*  of  the  human  capital  model  include  Cary  S.  Recker,  Human  Capital. 
Second  Edition.  New  York:  Columbia  University  Press  (for  Nat.  Rur.  Ecoru  Res.), 
1975,  and  Jacob  A.  Mincer,  Schooling  Experience  and  Earnings.  New  York:  Columhla 
University  Press  (for  Nat.  Rur.  Econ.  Res.),  1974. 

2.  See,  for  example,  loseph  E.  Stlglitz.  'The  Theory  of  Screening.  Education,  and  the 
Distribution  of  Income.*  American  Economic  Review  65  (June  1975):  283-300,  John 
C.  Riley,  'Testing  the  Educational  Screening  Hypothesis.'  Journal  of  Political 
Economy  87,  No.  5,  2(0ctoher  1979):  S227-S252,  and  Andrew  Weiss,  “A  Sortlng-cum- 
Learning  Model  of  Education.'  Journal  of  Political  Economy  91,  No.  3,  (June  1983): 
420-442. 

3.  This  argument  is  made  by  Robert  H.  Baldwin  and  Thomas  V.  Daula,  'The  Cost  of 
High-Quality  Recruits,*  Armed  Forces  and  Society  II,  No.  1  (Fall  1984):  96-114. 

4.  See  U.S.  Ceneral  Accounting  Office,  Report  to  the  Secretary  of  the  Army.  The 
Army  Need*  to  Modify  Its  System  for  Measuring  Individual  Soldier  Status.  Report  to 
the  Secretary  of  the  Army.  March  30,  1982. 

5.  J.  Johnson.  Econometric  Methods,  2nd  Edition.  New  York:  McCraw-HIII,  1972,  up. 
278-291. 

6.  Ibid,  pp.  28S-286. 
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r  A 


This  was  found  In  Roy  Nord  and  Thomas  V.  Paula,  Estimated  Time  to  Promotion  for 
Enlisted  Soldiers,  paper  presented  at  The  Information  Management/Operatlons 
Research  Society  of  America  Conference,  Roston,  M A;  July  1985. 

Barry  L.  Scribner,  D.  Alton  Smith,  Robert  H.  Baldwin  and  Robert  W.  Phillips,  Are 
Smart  Tankers  Better  Tankers:  AFQT  and  Military  Productivity,  Office  of  Economic 
and  Manpower  Analysis,  Department  of  Social  Sciences,  United  States  Military 
Academy,  December  1984.  The  paper  is  reproduced  In  the  Report  to  the  House  and 
Senate  Committees  on  Armed  Services,  Defense  Manpower  Quality,  Volume  II  (Army 
Submission),  May  1985  appendix  C.  Preliminary  regression  equations  for  the  training 
and  SOT  data,  generated  by  David  K.  Horne  and  Major  Thomas  V.  Paula,  are 
included  in  appendix  E  and  appendix  I  of  the  same  report. 
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